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A pilot project to attempt measurement of reactions of 
participants to the Technology Education Division program at the 
national convention of the American Vocational Association at St* 
Louis, MO was undertaken last December at the suggestion of Dr. 
Mike Dyrenfurth, T.E.D. Program Chair for the convention. The 
following is a brief synopsis of methodology, analysis and 
results. I would be pleased to share data, analysis, or 
interpretation da detail upon request. 

After analysis and resulting conclusions/ the instrument was 
revised and 500 copies of the revised instrument have been 
prepared. Student manpower from my institution, however, is 
unavailable this year. Suggestions for or assistance with 
instnament distribution and collection would be welcomed. 



After a review of the literature, a Conference Reaction Model 
was developed and subjected to peer review. After several 
revisions, it was determined to be adequate and instrument 
development was begun. The major requirement of the instrument 
would be to measure each element of the Conference Reaction Model 
at least once, be unambiguous and easily to use and easily 
subjected to statistical analysis. The literature was again 
reviewed, and a preliminary instrument was developed. With the 
assistance of several colleagues and after many revisions a 
satisfactory pilot instrument was developed. 

The sample of sessions at which the instrument was used at 
the 1992 conferen::e included a representative cross -section of 
general and specia] interest topics and was chosen by Dr. 
CN^ Dyrenfurth, program chair. Copies of the instnament were 

delivered to a total sait^jle of 12 selected sessions on Friday, 
Saturday and Sunday by Indiana State University students recruited 
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by the author. Instniments were distributed and collected by the 
session chairs and facilitators and returned to the author. Data 
were subjected to analysis using the Statistical Package for the 
Social Sciences, procedure CROSSTABS. 

Of approximately 350 instruments distributed, 127 completed 
and usable copies from 7 different sessions were returned. 
Approximately 70% were from the first and second General Sessions. 
Other sessions included the TEDD/NAITTE Research Symposium, the 
Technology Education Demonstration Project Session, Carousel, 
Technological Literacy, and TED/NAITTE Graduate Student Research. 
41.2% of those responding classified themselves as secondary 
teachers, and 37.8% as post -secondary teachers. 10.9% classified 
themselves as administrators, 1.7% as elementary teachers, and 
8.4% as other. 

Over half (56.6%) of all respondents listed "ideas for future 
action" as the primary reason for attending a session, and 85.2% 
were satisfied or ver^^ satisfied with the session. Over 70% of 
all respondents stated that the session attended was valuable to 
them and all (100%) of the respondents at the Carousel and 
Graduate Student Research found the session valuable. 

Over 60% of all respondents were satisfied or very satisfied 
with the conference program. As could be expected, reactions to 
the General Sessions were the most varied. General satisfaction 
was expressed with the physical facilities. The two items 
receiving the greatest variability of response dealt with the TED 
Program Schedule of sessions, and organization of individual 
presenters. The high variability of response on those items 
suggests relatively high dissatisfaction by respondents. 

After analysis and interpretation of data, the following 
recommendations are offered. As noted earlier, I would be pleased 
to share details of methodology, data, or analysis upon request. 

1. Results of the pilot project were successful in yielding data 
extremely useful in plaming future conferences. Systematic 
preparation for conference evaluation would result in more and 
better data. I there fore recommend that systematic evaluation of 
future conferences become routine, and I would be please to 
assist. 
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2 • The sainple of completed and usable instiruments available for 
analysis was very disappointing ♦ I believe that the sample rate 
could be greatly irrproved by developing and publicizing a standard 
system so that session chairs, facilitators , presenters, and 
participants are prepared for and expect measurement of conference 
reaction- 

3 . Great variability existed between reaction to different 
speakers and programs in the same session. This appeared to 
confuse and displease respondents and skew the measurement. It is 
recommended that efforts be made to increase the uniformity of 
programs within individual sessions in an attertpt to address this 
concern. 

4. Great variability of response to items addressing organization 
of individual presenters suggests respondent dissatisfaction. It 
is recommended that this be addressed by requiring more complete 
organization from those proposing programs early in the planning 
process . 



4 



CONFERENCE REACTION MODEL 



FORMATIVE (Organization of T.E.D. Program) 

Program Design 

Congruence with conference theme 
Scope of T.E.D. program 
Scheduling of T.E.D. program 

Lo gistics 

Assigned room and arrangement 
Audio visual equipment 
Chair person/facilitator 



SUMMATIVE (Presentation Evaluation) 

Dcniopraphics , . 

AUcndancc 
Who attended 
Why 



Content 

Congruence with T.E.D. goals 
Objectives developed 
Objectives accomplished 

Process 

Presentation organization 
Presentation delivery 
Results (satisfaction index) 
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Session Reaction Sheet 



Please return the completed form as you leave the room. 

This reaction form is designed to collect your immediate reaction to the content and process of this session and 
your general 'aedback on the conference. Your feedback will be used to evaluate this conference and plan future 
ones. 



Session # 



Session Title 



Clfcle the title that best describes you: Administrator Elementary teacher Secondary teacher Post-secondary teacher 

Other: (please specify) 



Your Company or School: 



State: 



1. 



What was your objective In attending this session? 

personal growth ideas for future action validate current activities 

professional development other: 



What benefits did you get from this session? 

new knowledge specific approaches, skills or techniques 

better understanding of Technology Education other: 



, change in attitude 



For the following, please circle the number corresponding to your opinion of the session 

Strongly Agree = 1, Agree = 2, Undecided/Neutral = 3, Disagree = 4, and Strongly Disagree = 5 



3. 
4. 
5. 
6. 
7, 

e. 

9. 

10 

11. 

12. 

13. 

14. 

15. 

16. 

17. 

18. 



I was very interested in this subject 

The session chair/facilitator did a good job. 

The room was uncomfortable and/or poorly arranged 

This has been a very good conference 

Needed A.V. equipment was present and functioning 

This session lits" the conference theme 

Few sessions at this conference have fit my needs 

It has been easy to attend rnosX sessions that interest me 

I understood the objectives of this session 

The objectives of this session were accomplished 

The session content was valuable to me 

The speaker was not well organized 

Time was well used by this speaker 

The speaker was interesting 

The speaker was knowledgeable of the subject 

This has been a very good session 



12 3 4 



12 3 4 

12 3 4 

12 3 4 

12 3 4 

12 3 4 

12 3 4 

12 3 4 

12 3 4 

12 3 4 



1 2 
1 2 
1 2 



2 
2 



5 
5 
5 
5 
5 
5 
5 
5 
5 
5 

3 4 5 



3 4 5 

3 4 5 

3 4 5 

3 4 5 



1 2 3 4 5 



Additional Comments: 
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